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ABSTRACT 

This paper contains a discussion concerning sose of 
the variables nhich threaten external validity and inferences about 
coBBunicative behavior Bade by researchers and teachers. 
CoBBunication researchers have begun to explore potentially 
artifactual sources of variance in judgBent^ of evaluations of 
coBBunicative behavior. Soae studies have shown that not only can 
expectations about another person's behavior affect the perceptions 
or judgBents of an ostensibly objective observer, but such 
expectations nay alter the behavior of the person being observed 
(known as the Pygnalion Effect) . observer bias, experiaenter 
expectancy, and Pygsalion effects are soaetises called "artifactual 
effects" or "experiaental artifacts." A tentative Bodel of 
potentially artifactual outcones in coBBunication assessaent is 
offered. (BB) 
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As a child I feared moving from kindergarten to the 
first grade. Indeed, so deep was my dread that my older 
sister and parents felt obligated to conduct a persuasive 
campaign designed to convince me that this move was per- 
haps the most important step toward manhood. I feared 
this passage and its associated rite - a march to the east 
end of the building - because they meant that I would be 
confronted by several new teachers, none of whom knew that 
I was a "good boy." My kindergarten teacher knew that T 
was good but the others did not. What if they decided I 
was bad? 

I need riot have feared as it turns out because miracu- 
lously the first grade teacher knew me. She appointed 
me a milk monitor early on the first day and later that 
afternoon assigned me to a group of Bluebirds, all the mem- 
bers of which were ^ surprisingly, good boys and girls also. 
This reinforced what I already knew: teachers were magi- 
cal beings who could instantaneously discern good from evil. 
It vas later in ny career that I came to realize that this 
foreknowledge was not miraculous, but was rather the rou- 
tine and predictable outcome of teachers' meetings and 
casual conversations in a room we were forbidden to enter 
called the lounge. Still later I learned that this fore- 
knowledge had long-term consequences for students, some of 
which were not good. 
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This anecdote is grounded in fact and I am sure that 
it reflects the experiences of many persons here. As teachers 
and researchers we form expectations about those whom we 
influence in our particular ways, i.e., our students and 
our subjects. Those whom we influt^nce similarly have ex- 
pectations about themselves and about us. There is a growing 
body of research which suggests that these mutual expecta- 
tions can powerfully affect perceptions, behaviors, and 
behavioral outcomes. 

General Research and Theory 

Researchers have known for many years that perception 
is selective; indeed attention, set, and attitude are clas- 
sical constructs in psychological research. For example, 
an early, ingenious study by Bruner and Postman demonstrated 
that persons may distort stimuli as seemingly objective as 
the color or suit of playing cards as a result of prior 
learning."^ Only recently, though, have researchers begun to 
demonstrate perceptual selectivity in persons culturally 
designated as rational performing ostensibly objective tasks. 
Experimenters and teachers have been shown to be other than 
neutral recorders of objective stimuli. In one of the 
first studies in this tradition, Cordaro and Ison led ob- 
servers to expect a high incidence of head turns and body 
contractions in one sample of planar ia and a low incidence 
of these responses in a second sample. The samples of 
planar ia were in fact identical. Observers in the high-ex- 
pectation condition reported twice as many head turns and 

three times as many contractions as those in the low-ex- 

2 

pectation condition. Simon induced high and low expecta- 
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tions in two groups of examiners and then had them score 

the same twenty responses to vocabulary items from a subtest 

of the Wechsler Intelligence Scale for Children. The 

responses were actually taken from protocals of children 

whose iQs ranged from 90 to 110. The mean score obtained 

by examiners with high expectations was higher than that 

3 

obtained by examiners with low expectations. 

Other studies have shown that not only can expectations 
about another person's behavior affect the perceptions or 
judgments of an ostensibly objective observer, but such 
expectations may actually alter the behavior of the person 
being observed. It has been shown, for example, that ex- 
perimenter's expectations regarding the performance of 

subjects on person perception tasks can have a predictable 

4 

effect on subjects' responses. Rosenthal has labeled this 
the "experimenter expectancy effect." 

In 1968, Rosenthal and Jacobson took the notion of 
experimenter expectancy out of the laboratory and into 
another ostensible bastion of objectivity, the classroom. 
In their famous and controversial study, Pygmalion in the 
Classroom , tne researchers demonstrated that teachers' 
expectations regarding the intelligence of their students 
under some conditions can produce actual changes in measured 
intelligence.^ Some recent studies have replicated the 
"Pygmalion effect", though others have failed to do so. 

Observer bias, experimenter expectancy and Pygmalion 

effects are members of a broader class sometimes called 

7 

"artifactual effects" or "experimental artifacts." Arti- 
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factual effects are potential threats to external validity, 
i.e., to valid generalizations about samples of data. For 
instance, behavioral effects mediated by an experimenter's 
expectations may be generalizable only to situations where 
experimenters hold the same expectations about their sub- 
jects. Such effects may not be generalizable to a broader 
population of subjects for whom no particular expectations 
are held regarding the particular class of behaviors ob- 
served. And frequently it is to this broader population 
that we wish to generalize. Indeed the research of Rosen- 
thal and others suggests that under certain circumstances 
broader generalizations may be spurious. 

More specifically, the inferences of communication 
researchers and teachers may be invalid for at least some 
of their typical purposes. A communicator may not be non- 
fluent, for example, as v/e often seem to assume, especially 
in our role as teachers. Rather he may be nonfluent in 
the presence of a teacher or experimenter expecting him to 
behave in that way. Nonfluencies may be demanded by the 
particular teacher or experimenter, and inferences about the 
communicator's level of nonfluency may be bound to the 
class: "observations made by person X." 

Communication Research and Potential Artifacts 

Communication researchers have begun to explore poten- 
tially artifactual sources of variance in judgments or eval- 
uations of communicative behavior. Pertinent studies typi- 
cally analyze variance attributable to the receivers of 
communications rather than to the communications themselves. 
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Organismic Differences 

Some studies have examined differences in judgments re- 
lating to idiosyncratic response tendencies of receivers and 
to personality differences. Bock provides some support for 
the claim that speech raters may differ in degree of leniency 
across speakers and that particular raters may consistently 
overvalue or undervalue one asoect of communicative perfor- 
mance, e.g., organization. In a study by Bostrom, raters 
scoring high on a rigidity scale were found to be more nega- 
tive and more variable in their evaluations of speakers than 
were raters scoring low in rigidity. Similarly, Bradac and 
Konsky found a relationship between the personality variable 
"internality-externality" and the degree of variability in low- 
inference judgments of communicative bi2havior.^^ 
Expectations and Observer Bias 

Other studies have tested the effects of listeners' 
expectations on judgments of communicative behavior. In 
some cases researchers examine effects of expectations which 
exist prior to and independent of the study and in others 
they create expectations before examining their effects. 
Burgoon had black and white subjects evaluate either mili- 
tant or non-militant black leaders to establish militant and 
non-militant response sets, then he had them rate the degree 
of militancy in a neutral message about black students. 
Results indicated that both black and white subjects in 
the response-set conditions differed from control sub- 
jects in a no response-set condition. Black subjects in 
the militant respons**-set condition ratf»d the message 
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as more militant than their counterparts in the non-militant 

response-set condition, though, surprisingly, the opposite 

12 

was true for the white subjects. 

* 

Hurt and Weaver used two versions of a taped message 
to evoke racial stereotypes in their subjects. In one 
version, th? speaker used black dialect and in the other 
he did not They found that subjects rated the speaker 
less favorably and that there was more distortion of his 
message when he used black dialect. Also, high-ethnocen- 
tric subjects distorted the message more than low-ethnocen- 

13 

trie subjects in the black dialect condition. 

Bradac, Courtright, Schmidt, and Davies told raters 
that they were about to hear a message delivered either by 
a high-status speaker or by a low-status speaker. Within 
each status expectancy condition, half of the raters heard 
a lexically diverse version of a message and half heard 
a lexically restricted version. On several evaluative 
dimensions, e.g., competence, dynamism, and language appro- 
priateness, a status X lexicon interaction occured. Speci- 
fically, the lexically restricted performance was evaluated 
extremely negatively in the high-status expectancy condition. 
This result presumably reflects the expectations middle- 
class listeners have about an appropriate language style 

14 

for high-status speakers. 

Bradac and Bell investigated the effects of observer 
expectations about a speaker's nonfluency level on nonfluency 
counts made during a taped spesch and on post-performance 
evaluations of nonfluency, anxiety p central idea, organization. 
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language, delivery, and general effectiveness. Tha influence 
of task ambiguity and medium of presentation on expectancy 
effects was also explored. Results indicated that observers 
who expected a fluent speaker counted fewer nonfluencies in 
his speech than observers who expected a nonfluent speaker; 
that fluent-expectation observers rated the speaker more posi- 
tively on the seven evaluative measures; that low task ambiguity 
eliminated expectancy effects on nonfluency counts and ratings 
of organization but not on the other six evaluative measures; 

and that auditory and auditory-visual presentations of the 

15 

speech did not produce significant differences. 
Reactive Effects and Pygmalion Effects 

Certain attributes and behaviors of message recipients 
have been shown to affect formal and substantive aspects of 
spoken messages. Effects of this sort are called "reac- 
tive effects by Webb, Campbell, Sechrest, and Schwartz. 
For example, Siegmann and Pope found that high-status inter- 
viewers elicit more speech from interviewees than do low-status 

17 

interviewers. Bradac and Konsky confirmed this finding, though 

their results indicate that this effect is qualified by the 

18 

type of evaluation anticipated by interviewees. Matarazzo 

has shown that there is a positive correlation between the 

duration of interviewers' questions and the duration of verbal 

19 

responses of interviewees. 

I know of no studies which have shown that the expecta- 
tions of receivers can affect the behavior of speakers. At 
this point we can only speculate about the existence of 
true pygmalion effects in communication It has been shown 
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that nonverbal feedback can affect speech performance, 
20 

however; and to the extent- that receivers' expectations 
may influence their nonverbal behaviors, eye contact and 
head nodding, for example, it seems likely that expecta- 
tions regarding speakers may affect speech performance. 

A Model of Potentially Artifactual Outcomes 
in Communication Assessment 

The studies I have just described and other studies 
as well indicate that certain receiver attributes, organ- 
ismic variables, and expectancies may influence judgments of 
communicative behavior. Ignorance of the effects of these 
variables may lead us to make erroneous inferences about 
the communicative behavior of students or subjects. 
Evaluations or judgments of communicative behavior may be 
bound to a particular teacher or experimenter, and they may 
not be valid indicators of general ability or general effects. 

Here is a model of potentially artifactual outcomes in 
communication assessment (figure 1). A receiver, (teacher 
or experimenter) has cultural expectations (stereotypes) , 
person-specific expectations, idiosyncratic response ten- 
dencies, and attributes (verbal and nonverbal signs repre- 
senting role, status, etc.). These variables influence 
the receiver's explicit judgments, which may be communicated 
verbally, and his or her implicit judgments, which are 
often communicated nonverbally. A communicator (student 
or subject) exhibits verbal and nonverbal behaviors which 
are affected by the receiver's attributes and by his or 
her verbal or nonverbal judgmental communications. The 
communicator's verbal and nonverbal communications affect 
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the receiver's person-specific expectations. Receiver^^ 
may corraiiUnicate his or her judgments to receiver 2 who in 
turn may assess the communicator's behavior. In this pro- 
cess, homeostasis v;ill be reached when the first receiver's 
expectations and judgments arc internally congruent and in 
some cases when th«y are congruent with the expectations 
and judgments of a second receiver. Disruptions of homeostasis 
may be reduced (or prevented) by shaping the communicator's 
behavior in such a way as to produce increasing accordance 
between this behavior and the receiver's expectations and 
judgments. 

Conclusion 

I have discussed some variables which threaten the 
external validity of our inferences about communicative 
behavior and I have given examples of pertinont research. 
A tentative model of potentially artifactual outcomes in 
communication assessment was offered also. 

Many important issues and studies have yet to be men- 
tioned. This will be the burden of the subsequent speakers. 
Mr. Davies will extend my model and will describe conditions 
under which the drive for balance between expectations and 
judgments may be increased or reduced. Professor Nof singer 
will relate some of the notions I have discussed to judg- 
ments of speech and language behavior. Finally, Professor 
Cegala will offer some suggestions about what we can do 
to increase the validity of our judgments about communi- 
cation behavior and thus increase the power of the infer- 
ences that we make as teachers and researchers. 
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